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The 1979-30 District 13 Haitian-Spanish Billnnual pronram (nrarit 
No. (3007700507) is the third year of a Bilimual Education pronrani 
funded under ESEA Title VII. The proqram operates In two public 
juninr hiqh schools in District 13 - J.H.S. 294 and I,S. 117. The ■ 
Junior Hiph School Billnnual Program is an intervention proqrari de- 
siqned to service students whose first languaqe is not English. ' 

The aim of the program Is to improve the English language com- 
petence of the students so that their school performance will be 
comoarable to that of their Enol Ish-speakinn peers. The pronram em- 
ploys the child's native tonnue (Creole or Spanish) as a medium of 
sub.iect matter instruction, while he/she is being helped to learn 
Ennlish. By enablinn students to master connitive skills in the 
language they know best, before making^ the transition to English, 
hllinnual classes are designed to prevent or minimize academic re- 
tardation. 

A secondary aim of the pronram is to enhance and maintain a 
child's proficiency in his native lannuane. Teachers are expected 
to draw on a child's herltaqe and culture as a means of building 
self-esteem and motivation to learn. 

Two hundred tv/enty-one students were enrolled in the Title VII 
prooram durinn the 1979-80 school year. Admission and discharge 
f inures indicate that at least forty students were exposed to the 
pronram for less than the full year. 

The New York City Board of Education Lamuane Assessment Batterv 



■ (LAP.) is used to deternilne profn-am elinlbility. The tv/entleth ntr- 
centile nark is the cut-off for placement in the Billnrrual proaram. 
Data for the Sprinq administration of this instrument Indicates 
that of the 155 students vihn were tested, 123 or 79.3% were below 
the twentieth percentile. Therefore, at least 55. Sr, of those en- 
rolled in the propram are knov/n to be below the twentieth percent- 
ile. The finure may be hioher due to missinn data. 

Test scures on the Spring administration of the Spanish ver- 
sion of the LAB are available for 119 Spanish-dominant students. Of 
these 119 scores, 40 were below the twentieth percentile. Thus, 
36.9% of those tested lack Spanish lanquane competence as defined 
by the LAB test. 

The Title VII pronram staff consisted'of a Director, Assistant 
Director, two Resource Teachers, a Teacher Trainer, a Community Re- 
lations Teacher, a Curriculym SDicialist, a Bilinnual Guidance 
Counselor, two Tamily Assistants and two Kducational Assistants. 
The staff also included einht full-tlnie tax-levy Bilinf?ual class- 
room teachers. 

The pronram at I.S. 117 consisted of five 3ilimual Spanish 
classes, (three 7th qrade and two 8th nrade) and the J. M.S. 294 
pronram consisted of two multlnraded Spanish classes and one multi- 
nraded {7-0-9) Haitian-Creole class. 



CVALUATIOM OESIf^N AND nBJECTIVES 



The evaluation effort follows the same format in 1979-80 as it 
has in t!ie past two years. It consists of both a process evaluation 
and a product evaluation. 

The ppocess evaluation calls for 'systeniatic classroom observa- 
tion and an on-noinq analysis of the pronran's direction and pro- 
gress. The evaluators discuss theif findinns Deriodically with the 
Pronram Director. This aspect of the evaluation 1s desinned to en- 
able the nirector and his staff to assess noals and objectives, iden 
tify strennths and weaknesses and expand upon effective modalities. 

As a result of these discussions, the direction of the Junior 
Hiqh School Bilinnual proaram with reference to ESL instruction was 
changed. In 1979-80, small, homoneneous nroups were formed for ESL ' 
instruction at both schools. Two hlnhly qualified and effective 
teachers implemented the pronram. 

In 1980-81, the Bninoual proaram is to be combined and housed 
in one buildino (I.S. 117) and it is hoped that It will result in 
qreater coordination and efficiency, nepartmental ization and indi- 
vidualized instruction should be a re«l possibility with this con- 
solidation. 

The product ovalufition was deslnnofi to assess the irrpact of the 
pronram on the nunlls' achievemsnt. The evaluation of this aspect 
of the program refers to the followinn objectives; 

1. Native Lanquane neadinfr Aehievnment . By the end of the pro- 



( 



qram year. pupiU v/ill exhibit a statistically siqnificant man nain 
in Native Lanquane Readinn scores. For Spanish-dominant students, 
this win be measured by the Inter-American Series Prueba de Lectura 
and by a prmram-developed or commercially prepared Creole readinq 
test for Haitian students, 

^' English Language Arts Achi evement (Reading ). Given a pro- 
gran of instruction in Enqlish. Bllinqual students will show a sig- 
nif leant mean gain in English languane reading as measured by the 
Metropolitan Achievement Test in Readinn . 

■ ■ ' \ 



PROnRAM IMPLFMENTATinN 



Introduction 

The evaluators made four rounds of visits to the two schools. 
Each visit was fonowed by a discussion with the Resource Teacher, 
the Teacher Trainer, and other Dronran staff. The finriinns 
scribed below are based on these observations and follow-un dis- 
cussions. 



Instructional Component 
Physical Settinn and Materials 

The Dnimual classes meet In reaular-slzed classrooms with 
flexible seating arrannements. However, the seats are never moved 
and the seatinq pattern is strictly traditional. The evaluators ob- 
served classes that typicany contained ten to fifteen students. 
(This was accounted for by low attendance rates and the provision 
of additional services on a pull-out ^basis). Small class size did 
not Influence seatinn arranqements or instructional strateoies. 

The rooms:, vary in terms of their attractiveness. Some have 
updated displays of student work, educational charts and posters. 
However, many classrooms can be characterized as drab. The boards 
and displays are either empty or sloppy. The tone which emernes in 
these cases is neqative. 

The Bllinqual Resource rooms contain an array of materials. 
Durinq our visits, we did not nhserve these matnrials in classroom 



use. ^lenerany the teachers in the oronram do not apncar to use a 
wide variety of materials and/nr techniques. This nrohlem was noted 
in last year's report and remains as a problep to be avercone in 
the future. It points to the need for clarifyinn the role of the 
Resource Teacher in roordinatinn materials with curricula. 
general redanony 

Lessons observed continue to be teacher-dominated and for the 
most Dart neared to Intact classes. Discipline is not a major prob* 
lem for most teachers. There are sone exceptionSt In these cases, 
the noiso level is so hinh, an observer could not hear the teacher 
talkinq. 

Several areas of neneral pedanony demand imediate attention: 
unaradinq teachers' subiect natter knowltdqe, improving techniques of 
lesson planninn, questioninci skills, and 1mplenent1nn classrooni rou- 
tines. 

In several instances, teachers were misinformGd and presented er- 
roneous information to their students. In the Social Studies and Enq- 
lish classes at I*S, 117, teachers were observed repeatedly acceptina 
an incorrtct ansv/er without corment. 

The most technically proficient teachers appear to he in the 
ESL conponent of the proqram. In both schools, these teachers are 
well nrnanized and present ful ly-developeH lessons. Students par* 
ticipate and arc Involved, There is apparently a qood relationship 
betv/etn the students and the teacher. 

The probltm of uporadina the neneral pedanonical skills of the 
teachers was exacerbated by the fact that the teacher trainer was , 



not preSGnt for the first three months of the school yefir. In ad- 
dition, she had to divide her time hetv/een the two sottinns. 
Lannuang Use 

Last year, the eva1uator$. noted three distinct patterns of lan- 
quaae use in the Juniar.-ttiah School classrooms. This yeaf, there - 
his been sonie Improvement in that a definite pattern established by 
the oroject Director Is beinn impleminted. Students are beinn taunht 
in their native lannuaqe and code-switchinn is kept to a mlninum. 

Several lannuaqe use problems persist. Students are charac- 
terized by heteronenei tv of lannuane skills and differential expo- 
sure to a fornial prooram of Bilinoual instruction. Many, if not 
most of the Hisnanic students are native New Yorkers, howevert 
there is a sinnificant number of nev/ arrivals. The lannuane skills 
of the two nrnups differ and indicate a need for a naappraisal of 
the lannuane stratenies. 

nicultural Asoect 

The Bilinoual classrooms are freauently decorated with posters 
and/or maps of the children's native countries. This cultural as- 
pect of the pronran continues to focus on the formal observation of 
holidays. As in the past, v/e did not observe teachers incorporatinn 
the bicultural theme in their lessons* 

Pprentnl Invol vcinept 

The Family Assistants are responsible for maintainlnn contact 
vfith the students' familieSp In 1979-80, they made home visits to 
those students v;ho v»ere continually absent or v/ho presented disci- 
oline poblems in the classroom. Chronic truancv (averane attendance 
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at I,S. 117 v/as 145 days; at O.M,5. 294, 151) is a continuinn prob- 
lem wliich the Family Assistant appears unable to resolve. While no 
special pronrams v/ore inplemented in the Junior Hiqh Schools to en- 
list parental involvement, parents felt free to call the schools 
and check on their children*! progress. The Family Assistant, on 
occasion p has accompanied parents to clinic appointments. 
Staff Development 

Tlvj Teacher Trainer and other District Staff members have been 
working directly v/ith the classroom teachers In the school settinq. 
In some instanceSi specific pedagonical skills have been upgraded, 
Hov/ever, there are a few teachers for whom this training has not 
been effective* 

The Bilinqual staff development emphasis in 1979-80 has focused 
on ESL* The pronram sponsored an ESL traininn wnrkshop at the Dis- 
trict nffice. Several teachers have chnsen to develop their ESL 
competence by enrol linn in a collene course at Lonn Island Univer- 
sity, The pronram paid the tuition. 
Curriculum Development 

The Haitian-Creole conponent has been usinq a level 2 book, 
Timoun Yo Ap Li , developed by the District staff. It consists of 
stories, proverbs and riddles in Creole, Social Studies curricula 
materials in Creole arr^ prps^titly teino developed* 




Pf IP I L AnHIE"C'CNT 

In order to ascertain the impact af the niHnnual pronram on' 
the students, scores from the M^t^nnnHtan Achievement Test (Readinn) 
and the Inter- Amen Ian Series, Prueha do Leetura were subjected to 

statistical analysis. 

In the 1978.79 Final Report, the evaluators recommended that 
achievetrent tests In anther suhlect areas^^be^deviloped^or selected.; 
This recommendation has not yet been implemented. It is also unfor- 
tunate that no measure of Creole lannuane competence was administered 
on a pre^DOst basis to the Haitian students. The ranne of student 
achievement suh:iected to statistical analysis is therefore limited. 

Appropriate levels of the pretests were administered in Mo- 
vember 1979. In May 19B0, . posttest scores were obtained. Two hun- 
dred twenty-one students were enrolled in the pronram at the two 
schools. There were 134 Spanish-domlnant students In five classes 
at 1.5. 117. At O.II.S, 294. there was one llaltian Creole class 
which consisted of 26 students (three seventh-grade Jtudents. eight 
enhth-nraders and fifteen ninth-nrade students) and sixty-one 

Spanish-rinn^inant sturients. 

The tnst #ta and analyses presented below are based on scores 
for less than the total pnpMlatlon. Matched pro and nost test 

^ - Mntrnoolitan Achie vement Test were submitted for 

143 students. This ronresehts 64? -of the ellnlble population, one 
hundred and ten matched scores were reported for the Spanish lan- 
nuane readinq test. This represents 56% of the ellnible Spanish- 



dominant students. 

nroup nay diffir siqnif icantly from the qroup that v/as not tested. 
Thus the analyses ppesented belov/ may or may not be representative 
of the achievenent pattern of the population belnn served. 

The statistical analyses used were t^ tests for correlated means. 
On the Metropolitan Achievenient Test comparisons were made between 
actual posttest scores and predicted posttists. Predicted posttest 



scores were derived usinn the New York State Historical Reqression 
formula. These scores represent an estimate of the students* ex- 
pected posttest scores had there heen no proqram interventlpnt 
(i*e., Dilinnual pronram). They are based on past rates of achieve- 
ment. If the t test values are sinnificant, it indicates that ac- 
tual nains are sinnif Icantly different from expected rates of a- 
chievement* 

This type of statistical comparison is presehted In ieu-of 
control nroup comparlsnnSi It should be noted that the Historical 
Reqress ion formula depends upon the use of grade equivalent scores. 
'There are several statistical and interpretive problems associated 
with the use of these scores^ and they m.ay present an Insensitive 
or distorted picture of the projact's impact. The formula was used 
so as to adhere to the pronram oroposal* 

Peadinn Achievement in Spanish 

One of the objectives of the Dilinnual pronram is to improve, * 
the native lannuaoe readinn skills of the students. The test used 
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to measure these skilis for Spanish lannuane reafiinn was the Inter- 
American Series, Prueba de Lectura , normative data and qradt equiv* 
alents are not available for this instrument* The t tests reported 
in Table 1 compare pre and nosttest levels of achievement. 

The data demonstrfttes lack of statistically sinnlf leant qrowth 
in Spanish rtadina as measured by this instrument. In qrades 3 and 
9, student mtan scores were lower on the posttest than on the pra- 
^^h. J^ll Jl^^ of sinni ^jcant n_r o\jth ijn Jpani s^t J anoua^ nn 
may be associated with the linaulstlc heteroqeneity of the students, 
problems in test administration or lack of compatabil i ty hetween the 
Spahish Lannuane Arts curriculum and the test* 

.Reading /Achievement ig English 

Student achievement in Ennllsh lannuane readinn was measure^by 
the Hetfopolitan Achievement Test . As Table 2 Indicates^ students 
In qrades 7, 8, and 9 scored hlnher In Enal ish lanqua^le readinn a- 
chievemeni at the end of the year than at the beninninn* The dif- 
ference between the actual posttest score and the predicted score 
(IMstorical Renression formula) was statistically sinnificant for 
eiqhth-nrade students. 
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TABLE 1 

Spanish Languaot Achievement ( Prueba de 
Lectura Raw Scores, Means, 
Standard Devlitions, ^ Tests) 



Pretest Posttest 
Mean Mean 
(SO) (SD) 



Prohabnity 



7 


39 


30.2 
(20.1) 


33.5 
(14.1) 


n.s. 


3 


58 


40.3 
(19.5) 


31.3 
(17.9) 


n.s. 


9 


13 


57.6 
(28.9) 


51.2 

(24.1) " 


n.s. 



TABLE 2 • 
English Reading Achltvemint by Grade ( Metropolitan 
Achievement Test Rrade Equivalents. Means. 
Standard Deviations, t_ Values) 



Rrade 


n 


Pretest 
Mean 
(SO) 


Posttest 
Mean 
(SD) 


Predicted 
Posttest Mean 
(sn) 


t_ Value 






44 


3.87 
(1.56) 


3.80 
(1.61) 


4.20 
(1.74) 


- 1.37 


8 


73 


3.86 
(1.68) 


4.62 
(1.90) 


4.15 
(1.85) 


4.18*^ 


9 


26 


4.52 
(2.31) 


4.87 
' (1.95) 


4.83 
(2.51) 


.13 



g 



*** 

Sinnificant at .001 levfel 



RECOMflEflDATIONS 



I . Testing 

1. The Prograni Directof should develnp and Implement a com- 
prehensive testing policy for the Pronram. This should 
include an orientation to all pronram personnel on ad- 
mfn rstef 1 ng , scor 1 nn and^Tnterpret i no test da taT Itan- 
dardlzed record keeping should be instituted. 

2. Pretests should be administered during the first month 
of the school year. 

3. It is important that measures of achievement in subjicts 
other than Ennlish and Spanish readifln be developed or 
selected fnr inclusion In pronram evaluation. 

4. In order to obtairi an accurate assessment of student 
achievement, all students should be accounted for in the 
testing pronram. . 

II. Title vn. Staff 

In order to obtain the optimal impact frofn the Title VII staff 
(1.6., Rasource Teacher, Teacher Trainer, Curriculum Specialist and 
Comnunity Relations Teacher), the roles must be dfefined clearly, the 
responsibilities coordinated and the performinets monitortd. The 
proposed consolidation of the pronram into one site can facilitate 
this task. Furthermore, the pronram must be inteqrated Into the 
total school settlnni especial Ty with reference to instructional 



supervision. ., 
in. Truancy 

In somt clarses, chfonic truanc.y Is a serious problem which 
inhibits pronram functioninn and limits student achievement. Stronn 
er, more direct procedures for overcoming this problem are necessary 
Parents must be made aware of the importance of regular school at- 
tendance. There is sufficient staff to deal with this problem and 
it should become a priority for the cominrj yBar. 

IV. Staff Development 

There is a need for a staff development program that incor- 
porates neneral educational techninues as well as bilinciual teachinfl 
strateqies. Teachers should be encouraned to attesid appropriate 
v/orkshops and enroll in courses that v/ill directly enhance their 
classroom skill s. 

y. Sicul tural 

- -The Mcultur*l aspect of the program should be expanded beyond 
the obvious holiday observances. The population beinn served is, ' 
in effect, multicultural. Aside from Haitian and Puerto Rlcan His- 
panic populations, many Spanish-speakinn students oome from coun- 
tries in. Central and South Anierlca. Their cultural heritane and ^ 
experiences should be an intenral part of thi day-to-day curricula. 



V^. student Plac e nient 

, At l^east 25K of thi Spanish-speakinf] population scorad below 
the. twentieth [lercentilo on the Spanish version of the LAD test. 
The needs of these students differ from those whose formal readtna 
skills in Spanish are rnore developed. Alternate stratenies for 
deal inn with these students should be designed. Provision must be 
made for testinn and placinq those children whose academic achieve- 
jaant j.iJ.liiu±fid_hjL.f:actop^^^^ 
abilities, emotional problems, etc.). 



